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Abstract 

We describe how the methods of quantum field theory and the 
renormahsation group may be apphed to classical stochastic particle 
systems which appear in non-equilibrium statistical mechanics. An 
emphasis is placed on the similarities and differences between these 
methods and more conventional applications of quantum field theory. 
Some simple applications are discussed. 

1 Introduction 

Reaction- diffusion problems are simple examples of non-equilibrium statisti- 
cal systems. While it has long been recognised that the methods of quantum 
field theory extend far beyond their original domain of application in ele- 
mentary particle physics, to, for example, many body quantum systems in 
condensed matter physics, and to the theory of both the statics and dynamics 
of critical behaviour in equilibrium statistical mechanics, it is less well appre- 
ciated that they also provide a powerful tool for analysing classical statistical 
systems far from equilibrium. This application is certainly not new,|I|, Q, 
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but it is only relatively recently that the full formalism of the renormalisa- 
tion group has been brought to bear, ^, |^ in a very similar manner to that 
employed in equilibrium critical behaviour. 

React ion- diffusion problems are examples of classical stochastic particle 
systems. These particles are in general labelled by their species A,B,..., 
which may be thought of as corresponding to different chemical reactants. 
Their dynamics consists of two elements: first, the particles diffuse according 
to some kind of Brownian motion, with diffusion constants Da, Db, ■ ■ ■■ In 
a simulation, this might be described by random walks on a lattice. Sec- 
ond, they undergo reactions, for example A + B ^ C, at prescribed rates 
A^^, whenever they meet. It is important that these processes are diffusion- 
limited, that is, the particles have to diffuse around before they find each 
other and react. In a chemical system this would mean that the reactants 
should not be stirred. In practice this may be realised by allowing the reac- 
tants to diffuse in a gel, or on a substrate. It is important to realise that the 
these reactions are not usually reversible, and indeed the most interesting 
cases occur when they are completely irreversible. 

The potential applications of these ideas to systems in chemistry, biology 
and physics are limited only by the imagination of the reader, and this is not 
the place to discuss them. Rather, we shall focus on some general features 
as illustrated by some rather simple examples. In general, from some ran- 
dom initial state, these systems will evolve in time towards a steady state 
described by some stationary probability distribution. Since the dynamics 
does not satisfy detailed balance, this is not in general a Gibbs measure. 
In some very simple cases, the steady state is trivial. For example, in the 
simplest system of all, with a single species of particle A undergoing the pure 
annihilation reaction A + A ^ inert (the inert particles not influencing the 
reaction further), the steady state has no particles, and hence no fluctua- 
tions since it is a classical vacuum. But it turns out that the approach to 
this steady is critical in the sense that it exhibits universal scaling behaviour, 
critical exponents, and so on. This may be understood, and the universal 
features computed, within the quantum field theoretic renormalisation group 
approach to be described. 

A second class of critical phenomena corresponds to a non-equilibrium 
phase transition in the steady state, as some parameter of the dynamics 
is varied. For example, if to the annihilation reaction described above the 
branching process A —>■ {m + 1)A at rate a is added, it turns out that under 
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some circumstances there can be a transition at some finite value of a to a 
non-trivial stationary state with a finite density of particles. [0, The 
universality class of this transition turns out to depend on the parity of m. 
As with equilibrium critical behaviour, the symmetries of a system are seen 
to play an important role in determining its universality class. 

The layout of this paper is as follows. In the next section we describe the 
general formalism and illustrate it with the annihilation reaction A + A ^ 
inert. We comment on the similarities and the differences with ordinary 
many-body quantum theory, and on the connections between this approach to 
non-equilibrium behaviour and others via the Fokker-Planck equation and the 
Langevin equation. In Sec. ^ we discuss the renormalisation group approach 
to the A + A^ inert reaction in more detail, and finally in Sec. ^ we consider 
the more difficult problem of when the branching process is added. 

2 Formalism 

The dynamics of such a stochastic particle system is described by a master 
equation governing the time evolution of the probabilities p{a; t) that the 
system be in a given microstate a. For a system of particles on a lattice, 
for example, the as might label the occupation number basis (rii, ?t,2, . . .), 
corresponding to having rij particles at site j. The master equation takes the 
form 

dp{a;t)/dt = J2 Rp^aPiP^t) -^Rc,^pp{a;t). (1) 

Here Ra^p is the rate for transitions from state a into /5; for a reaction 
diffusion-problem these are determined by the diffusion constants and the 
reaction rates. 

Such classical particle problems have two features in common with rel- 
ativistic many-body problems which renders a 'second-quantised' formalism 
particularly useful. First, particle numbers are not, in general, conserved: 
they are created and destroyed by the dynamics. Second, and more impor- 
tant, the master equation and the Schrodinger equation share the properties 
of being linear and first order in time. It is therefore not surprising that such 
a formalism is similarly successful for these stochastic problems. 

The first step is to construct a Fock space from annihilation and creation 
operators satisfying the usual commutation relationships [ai,a"^j] = 5ij, and 
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define the state vector 

\^{t))^^p{n„n„...;t)a^T^7---\0)- (2) 

a 

Note that this is not normalised in the conventional manner, and what plays 
the role of a probability amplitude in quantum mechanics now is a probabil- 
ity. We have also chosen a bosonic representation, corresponding to the case 
when multiple occupancy of the sites is allowed. In simulations it is often 
more convenient to restrict the values of the Uj to or 1, in which case a 
representation in terms of Pauli operators is more appropriate. This leads 
to quantum spin models rather than immediately to quantum field theories, 
which, in some one-dimensional cases, turn out to be integrable. In fact 
there is a some very elegant mathematics in this branch of the subject. [§] 
For example the quantum group symmetry of certain spin chains appears 
very naturally from this perspective. However, from the point of view of 
understanding the renormalisation group approach and generalising to non- 
integer dimensions, the bosonic formulation is more useful. In any case, as 
long as we are studying problems where the average particle density is low, 
the probability of multiple occupation should be small and there should be 
no difference between the physical results of the two approaches. 

The statement is now that the master equation (|l]) is completely equiva- 
lent to a Schrodinger-like equation for the state vector 

d\'^{t))/dt= -H\<i/{t)), (3) 

where the 'hamiltonian' H is simply expressed in terms of the as and the 
a^s. For example, for the reaction-diffusion problem A + A^ inert, one finds 
that 

H = D J2iaU - a^j){ai - aj) - X ^(a- - a^'-a,^). (4) 

The simple hopping form of the first term (where the sum is over nearest 
neighbour pairs which corresponds to pure diffusion, is not surprising, 

but the second term may require some explanation. To understand its form, 
consider the simpler problem of the reaction at a single site. If p{n; t) is 
probability of finding n particles at this site, the master equation is simply 

dp{n;t)/dt = X{n + 2){n+ l)p{n + 2;t) - Xn{n - l)p{n;t), (5) 
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where the factors of {n + 2)(n + 1) reflect the number of ways of choosing 
the pair of reacting particles. Defining = I]nP('^; |0) as above, its 
equation of motion is 

d\'^)/dt = Xj2{{n + 2){n + l)p{n + 2) -n{n-l)p{n))a^"\0) (6) 

n 

= A^(aV(n + 2)at"+'-atVp(n)at")|0) (7) 

n 

= X{a^ -a^\^)J2p{n)a^^\0). (8) 

n 

The second term in the reaction part of (|) therefore corresponds to the 
second term in the master equation (|I|), and is required by the conservation 
of probability. 

From the lattice hamiltonian (|^) we may, if interested in long wavelength 
properties, proceed to the formal continuum limit 

H = J [D{Va^){Va) - X{a^ - a^\^)]d% (9) 

and thence to a representation as a path integral over fields a{x, t) and a*(x, t) 
with a weight exp(— 5'[a, a*]), with an action 

S = j {a*dta + D(Va*)(Va) - X{a^ - a*^a^)]dtd'^x. (10) 

2.1 Differences from quantum mechanics 

There are two immediately apparent differences from ordinary quantum field 
theory: first, there is no factor of i in the Schrodinger equation @ - but this 
is familiar from euclidean formulations of conventional quantum theories; 
second, the hamiltonian is not hermitian. In many cases it will turn out 
that, nevertheless, its eigenvalues are real. (Complex eigenvalues correspond 
to oscillating states which are known to occur in some chemical reactions.) 
However, the most important difference is one of interpretation: expectation 
values of observables O are not given by (\Ef since this would be bilinear, 

rather than linear, in the probabilities p{a]t). Instead, for an observable 
which is diagonal in the occupation number basis, its expectation value is of 
course 

0=Y.Oi{n,})pi{n,};t), (11) 
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and it is straightforward to show that this may be expressed as 



Ce-^*|^(0)) 



(12) 



since the state (0|e^j 




Conservation of probabihty then requires that {0\e^i°'^H = 0. This is 
equivalent to the requirement that H should formally vanish when every a^j 

is set to unity. The appearance of the state (0|e^j "^ may complicate some of 
the subsequent calculations, since the interaction part of the hamiltonian is 
not normal ordered with respect to it, and therefore the usual formalism of 
time-dependent perturbation theory and Wick's theorem do not immediately 
apply. This problem may be avoided by first commuting the factor of ""^ 
through the operators O and H in (|12|). This has the effect of shifting 
flT — i> 1 + a^, since e"a^ = (1 + a^)e°. The factor e^j "^ acting on the initial 
state |\E'(0)) is usually something simple, and the operators are now normal 
ordered. 

Note that such a shift is convenient only if we are interested in what (in 
the language of particle physics) may be termed 'inclusive' probabilities, for 
example the expectation value of the local density Uj = a^jaj. After the 
shift, we see that in fact nj = (aj), where (■) denotes the usual QFT expec- 
tation value. For so-called exclusive quantities, for example the probability 
^riiiUj^Li^njO that there is only one particle in the system, at site i, the fac- 
tor e^j "^ simply reduces to aj in the correlation function, and no shift is 
necessary. 

2.2 Relation to other formalisms 

Of course, there are several other important ways of formulating stochastic 
processes, through either the Langevin equation or its related Fokker-Planck 
equation. It is interesting to see how these emerge in the present formalism 
for the simple example under consideration. If we make the shift a* = 1 + d 
in the path integral, we find an action 



S[a, d]= [ddta + L'(Va)(Va) + 2\da^ + \d^a^]dtd'^x. (13) 
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The non-linear terms in a may be disentangled in terms of a Gaussian trans- 
formation 

g-Aa2a2 _ r e-'?ap(^)^^^ (14) 



where P{t]) is suitable Gaussian distribution. The path integral over a may 
now be performed, yielding a functional delta function equivalent to the 
equation 

dta = DV^a-2Xa'^ + ri{x,t). (15) 

Neglecting the last term, this is just the so-called rate equation which one 
might write down as a first approximation to the equation of motion for the 
density (note that we have argued above that the expectation value of a is 
the density.) The rate equation approximation assumes that the annihilation 
rate, which is proportional to the probability of finding two particles at the 
same point, is simply given by the square of the density. This approximation 
clearly neglects the correlations between the particles, and is on the same 
footing as the mean field approximation in equilibrium critical behaviour. In 
this sense ( plSj) looks very much like a Langevin equation, with a noise term 
rj. However, such equations are usually derived from the master equation 
through some kind of approximate coarse-graining, and the exact form of the 
noise term is often unclear, especially when the dynamics does not constrain 
this through detailed balance. By contrast, the correlations of the noise here 
are completely explicit 

{r]{x, t)r]{x', t')) = -Xa'^5{x - x')5{t - t'). (16) 

That the noise should depend on a is expected, since there can be no noise 
when the density is zero. But the minus sign is surprising. It implies that 



the noise rj is pure imaginary, so that the solution of (|1^) is complex! 

This curious result may be traced to the fact that, although the 'quantum 
mechanical' average (a) is the mean density n, this is not true of higher 
moments. For example, the mean square density is given by the average 
of (a^a)^ = + a'^a. The operators give unity acting to the left on the 
state (0|e'^, so that in fact = (a^) + (a). In general, one may show that, if 
a has a Gaussian distribution, as it would in the case of pure diffusion, then 
the density n would have a pure Poisson distribution. This is to be expected, 
since a simple random walk will have Poissonian statistics. The effect of the 
reactions is to modify this. In a sense the 'noise' 1] in (^) represents only 
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Figure 1: Vertices and renormalisation for A + A ^ inert. 

that part of the physical noise which originates in the discreteness of the 
reaction process. Since, however, this cannot truly be disentangled from the 
diffusion noise, there is no need for its correlations to be positive. 

The hamiltonian approach we have described above should be distin- 
guished from another based on the Fokker-Planck equation. The latter begins 
from a coarse-grained Langevin description of the problem, and describes the 
time evolution of the probability distribution of the solution of this equation. 
Like the master equation, it is linear and first order in time, so may be cast 
in a hamiltonian formalism (in this case more usually called the liouvillean.) 
But the Fokker-Planck equation describes the diffusion in phase space and 
cannot easily accommodate processes where particles are continually being 
created and destroyed. It is therefore less useful for these types of problem. 

3 Renormalisation group analysis 

The field theory described by the action (|13D is extremely simple. The bare 
propagator {—iuj + Dq^)~^ is simply the Green function for the diffusion 
equation, and it may be represented by a directed line moving forward in 
time (conventionally from right to left.) The vertices are shown in Fig. |l[ 
Immediately we see that, since the number of particles in a given intermedi- 
ate state cannot increase as we move from right to left through a diagram, 
there can be no loop corrections to the propagator, hence no wave function 
renormalisation for the fields a or a. The only non-trivial renormalisation is 
that of the coupling constant A, which may be seen through the loop correc- 
tions either to the vertex F^'^ (shown in Fig. [l|) or to F^'^. (The fact that 
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these renormalise in the same way is a consequence of probabihty conserva- 
tion, which relates the untruncated Green functions {0\a{t,x)a'^ (0,0)|0) and 
(0|a^(t, x)a"'"^(0, 0)|0). It is interesting to note that probabihty conservation 
is not expressed through a Noether symmetry in this formahsm.) The dia- 
grams in Fig. correspond to a simple inclusion-exclusion argument for the 
probability of finding two particles at the same point given that they have 
not reacted in the past. They may be simply summed, with the result that 
the one-loop renormalisation group beta function is exact: 

P{gB) = -^9R + hgl, (17) 

where qr is the dimensionless renormalised coupling, fe is a positive constant, 
and e = 2 — d. 

For d > 2, then, gji is irrelevant in the infrared, and the rate equation 
(|15D with no noise term is asymptotically valid, while for ci < 2 it flows 
to a non-trivial fixed point g* = 0(e). The consequences of this may be 
explored by writing down and solving the Callan-Symanzik equation in the 
usual way. Consider, for example, the mean density n{t), which depends in 
principle on the initial density rio and the rate A, expressed through and 
the normalisation scale to- (We work in units where the diffusion constant 
D = 1.) Then 

n{t, no, gR, to) = (t/to)"''/' n{to, no{t/toY'\ ~gR{t/to)M) (18) 

where the running coupling gR g* a.s t/tQ oo. The simple exponent 
in the prefactor on the right hand side reflects the lack of any anomalous 
dimensions for the density. The right hand side may now be evaluated as 
a power series in g* (the lowest order being simply the mean field result), 
which is converted into a power series in e. Term by term, one may show that 
the result is in fact independent of the initial density no, so that in fact the 
whole expression is a universal function of e only. The result is n(t) ~ Ajt'^l'^ 
where 0] 

1 21n87r - 5 , 

A=— + + 0e. 19 

47re loTT 

Universal forms for correlation functions may be derived in a similar manner. 
The result is that the whole probability distribution for fluctuations becomes 
universal in the late time regime. 
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4 Branching and annihilating random walks 



A more interesting type of critical behaviour emerges if to the annihilation 
reaction A + A inert we add the branching process A ^ {m + 1)A, with 
rate a. Here m is a positive integer. In the rate equation approximation, the 
mean density now satisfies 

dn/dt = (Tmn — Xti^, (20) 

which would suggest that, for any cr > 0, the steady state has a non-zero 
density of particles (it is 'active' in the language of catalysis.) In fact, sim- 
ulations suggest that this is only true in sufficiently high dimensions d > 2. 
For d < 2 the fluctuations need to be taken into account, and this may be 
done using the formalism described above. 

In one dimension, with m = 2, this model may be interpreted as a dy- 



namic Ising model, where the particles play the role of domain walls. ||T0[ In 
that case the processes of diffusion and annihilation are generated by single 
spin flips (these are assumed to occur at zero temperature so that pair cre- 
ation of domain walls is suppressed), and the branching process A 3 A is 
associated with spin exchange (assumed to occur at infinite effective temper- 
ature). Since this model has two 'temperatures', it does not satisfy detailed 
balance and the stationary state is not Gibbsian. For that reason the model 
may undergo a nontrivial ordering transition, even in one dimension. 
The additional term in the hamiltonian has the form 

Hh = a f [a^"'^\ - a^a]rf1r. (21) 



Note that there is a difference depending on the parity of m. If it is even, 
then the number of particles is locally conserved modulo 2 by both the anni- 
hilation and the branching process, while for m odd the latter violates this. 
For m even this is manifested in the formal symmetry of the hamiltonian 
under {a,a^) — > (— a, — a^). Note that if we make the shift a''' — *• 1 -|- a in 
order to develop the perturbative expansion for 'inclusive' processes, this 
symmetry becomes hidden. If we further make an expansion of the hamilto- 
nian in powers of a, and drop higher orders on the grounds of irrelevance by 
power counting, the symmetry is completely lost. This is evidently a dan- 
gerous thing to do, since it is well known that symmetries play a very impor- 
tant role in influencing universality classes of critical behaviour. Fortunately 
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the renormalisation group behaviour of the theory should be independent of 
which type of correlation functions we choose to study, and therefore may be 
computed in the unshifted theory where the symmetry is manifest. 



4.1 Case of even m 



The first question to be addressed] 11] is whether the branching rate a is 



relevant at the pure annihilation fixed point, that is, in the beta function 
P„ = —ya + O(cr^), is ?/ > 0? If so, then as soon as cr 7^ it will flow 
away in the infrared into what is presumably the fixed point controlling the 
active phase. For d > 2, the pure annihilation reaction is controlled by the 
gaussian fixed point, so simple power counting suffices. This yields y = 2, 
consistent with the simulation results. For d < 2, the annihilation fixed point 
is accessible within the e = 2 — d expansion, and so y may be computed only 
perturbatively. The result is that JTT| 

l/ = 2-|m(m + l)e + 0(e^). (22) 

Notice that the 0(e) corrections are large in d = 1, but no conclusion may 
be drawn from this since the higher terms have been neglected. 



Fortunately it is possible to compute y exactly in d = l.[|TTl There are 
several ways of doing this, but the simplest is to realise that in this limit 
it becomes a kind of a free fermion problem. This is because going to the 
annihilation fixed point gji g* corresponds to taking the limit of the bare 
coupling A ^ 00. In that case the term a? in (^ corresponds to an 
infinite hard core repulsion, so that the particles behave in one dimension 
like free fermions, at least in those periods of time evolution during which 
the other terms in the hamiltonian do not play a role. (For this reason the 
problem is not completely equivalent to free fermions.) In that limit, it does 
not make sense to create the new particles at the same lattice site. The best 
one can do is to distribute them between m neighbouring sites, so that the 
corresponding term in the lattice hamiltonian has the form 

3 + — 

ri c^^c,, (23) 

where c^i and Cj are now anticommuting operators. In the continuum limit, 
we may make a Taylor expansion of each c^j about i = j, in powers of the 



11 



lattice spacing b. The lowest surviving term has the form 




(24) 



where a = alf^'^'^^^^/'^ is now the effective expansion parameter in the contin- 
uum limit. This extra factor modifies the dimensional analysis, which then 
implies that 



simple explanation of this, as we have also computed exphcitly the O(e^) 
terms and find them to be non-zero. 

However, this does imply that the branching is irrelevant at the pure an- 
nihilation fixed point for d = 1, and hence the infrared or late time behaviour 
for sufficiently small a should be that of the pure annihilation process, with 
finitely renormalised parameters (for example, the diffusion constant.) It 
may also be shown that, even if the original branching process does not 
allow for m = 2 processes, these will inevitably be generated under renor- 
malisation, and, since this coupling is the most relevant, it controls the late 
time behaviour. Physically both these effects may be understood as follows. 
In pure annihilation, the surviving particles become strongly anticorrelated 
in space. This is because each sweeps out a region around itself: for d < 2, 
every test particle placed within that region has probability one of eventu- 
ally annihilating with it. (For d > 2 the test particle may escape.) When 
a small branching rate is turned on, the single particles occasionally branch 
into bunches of 3,5,... particles but these stay close together, and almost 
always annihilate with their siblings before visiting other bunches. The effect 
is therefore of diffusing bunches, which behave in many ways like single par- 
ticles with a reduced diffusion constant. Clearly even if branchings only with 
m > 2 are allowed, the pair annihilation process will generate an effective 
m = 2 branching rate. 

For larger values of the branching rate a there should be a transition 
to the active state, which should correspond to some nontrivial fixed point 
of the renormalisation group. But it seems to be very difficult to analyse 
this within any perturbative renormalisation group scheme. This is because 
the problem has two critical dimensionalities: d = 2 associated with the 
nontrivial nature of the annihilation, and ~ | where the value of y changes 




result 




12 



sign, and therefore no systematic e-expansion is possible. So far we have 
not been able to find another small parameter, and the best we can do is a 
truncated loop expansion in fixed number of dimensions. This leads to the 
expected fixed point, but the estimated values for the critical exponents are 
far from those measured in simulations. 

4.2 Case of odd m 

Although the above analysis might suggest that for m = 1 the branching 
rate is relevant even when d = 1, so that there is no nontrivial transition, 
this is not the case, since now there is no conservation law modulo 2, and 
the process A — >■ is immediately generated under renormalisation. This has 
eigenvalue 2 and corresponds to the generation of a mass gap in the theory. 
In fact one may show that for small branching rates the mean density should 
decay exponentially to zero. This conclusion is valid even when d = 2: 
although in this case the annihilation rate which generates the new term is 
irrelevant, it is only logarithmically vanishing, and meanwhile the rate for the 
process A ^ is growing under the renormalisation group. Once again, for 
sufficiently large a, there should be a transition to the active state. In this 
case it is rather easier to analyse. On including the effective term A (a — a^a) 
in the hamiltonian, corresponding to A — 0, and making the shift — > 1 + a, 
one finds an interaction hamiltonian of the form 

Hint = J [Sda + nida^ — 1x20!^ a + ■ ■ -jdlr, (26) 

where fii and /i2 are positive constants, and 6 may change sign (as it does 
at the mean field transition.) The omitted terms are of higher order, and 
their neglect is, this time, justified, since there is no symmetry relating them 
to the lower order terms. This is a well-known theory [p!^ which describes 
the universality class known as directed percolation (DP), although it was 
first studied by particle physicists in the context of reggeon field theory. 
Generically, any dynamical phase transition from an inactive state, with no 
noise, to active one, is in the DP universality class, and this has been verified 
for a number of models. The branching and annihilating random walks for 
m even and d = 1 are therefore an interesting exception to this general rule. 
They evade it because they posses an additional conservation law. This is of 
course quite a familiar idea from equilibrium critical behaviour. 
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5 Conclusions 

These simple examples I hope illustrate the point that quantum field theory 
still has many unexplored applications, which are not limited to quantum 
systems nor to equilibrium critical behaviour. Perhaps we are not yet at the 
stage when the mathematical beauty of such applications is apparent, but 
the richness of the subject is such that I believe that this may well emerge 
in the years to come. 
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